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.4.^ , For an absolutely continuous (integer-valued) r.v. X of the Pearson (Ord) family, we show that, 

2 ' under natural moment conditions, a Stein-type covariance identity of order k holds (cf. [Goldstein 

and Reinert, J. Theoret. Probab. 18 (2005) 237-260]). This identity is closely related to the 
corresponding sequence of orthogonal polynomials, obtained by a Rodrigues-type formula, and 
provides convenient expressions for the Fourier coefficients of an arbitrary function. Application 
of the covariance identity yields some novel expressions for the corresponding lower variance 
bounds for a function of the r.v. X, expressions that seem to be known only in particular cases 

VQ ' (for fhs Normal, see [Houdre and Kagan, J. Theoret. Probab. 8 (1995) 23-30]; see also [Houdre 

^O , and Perez-Abreu, Ann. Probab. 23 (1995) 400-419] for corresponding results related to the 

fT^ ' Wiener and Poisson processes). Some applications are also given. 

j-TT^ I Keywords: completeness; differences and derivatives of higher order; Fourier coefficients; 

Set , orthogonal polynomials; Parseval identity; "Rodrigues inversion" formula; Rodrigues-type 

^•^ ' formula; Stein-type identity; variance bounds 

k^ ■ 1. Introduction 

H , 

5t 1 For an r.v. X with density /, mean /i and finite variance ct^, Goldstein and Reinert [18] 

showed the identity (see also [26]) 

Coy{X,g{X))=a'E[g'{X*)], (1.1) 

which holds for any absolutely continuous function g : M — > R with a.s. derivative g' such 
that the right-hand side is finite. In (1.1), X* is defined to be the r.v. with density 
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508 G. Afendras, N. Papadatos and V. Papathanasiou 

Identity (1.1) extends the well-known Stein identity for the standard normal [33, 34]; 
a discrete version of (1.1) can be found in, for example, [13], where the derivative has 
been replaced by the forward difference of g. In particular, identities of the form (1.1) 
have many applications to variance bounds and characterizations [4, 13, 26], and to 
approximation procedures [11, 14, 15, 18, 27, 31, 33]. Several extensions and applications 
can be found in [10, 19, 29]. 

In [23], the (continuous) Pearson family is parametrized by the fact that there exists 
a quadratic q{x) = Sx^ + /3a; + 7 such that 

i^l^t)fit)dt = q{x)fix), xeR. (1.2) 

Typically, the usual definition of a Pearson r.v. is related to the differential equation 
f'{x)/f{x) = (a — x)/p2{x), with p2 being a polynomial of degree at most 2. In fact, the 
set-up of (1.2) (including, e.g., the standard uniform distribution with q(x) = x{l — x)/2) 
will be the framework of the present work and will hereafter be called "the Pearson 
family of continuous distributions". It is easily seen that under (1.2), the support of X, 
S{X) = {x : f{x) > 0}, must be an interval, say (r, s) with —00 <r<s< 00, and q{x) 
remains strictly positive for x € (r^s). Clearly, under (1.2), the covariance identity (1.1) 
can be rewritten as 

E[{X - ^i)g{X)] = E[q{X)g'{X)]. (1.3) 

It is known that, under appropriate moment conditions, the functions 

Pkix)=^-j^^[qHx)fix)], xeir,s), k = 0,l,...,M (1.4) 

(where M can be finite or infinite) arc orthogonal polynomials with respect to the density 
/ so that the quadratic q{x) in (1.2) generates a sequence of orthogonal polynomials by 
the Rodrigues-type formula (1.4). In fact, this approach is related to the Sturm-Liouville 
theory, [17], Section 5.2; see also [24, 28]. 

In the present paper, we provide an extended Stein-type identity of order k for the 
Pearson family. This identity takes the form 

E[Pk{X)g{X)]=E[q'^{X)g^'^\X)], (1.5) 

where g^'^^ is the fcth derivative of g (since Pi{x) = a; — /i, (1.5) for k ~ 1 reduces to 
(1.3)). Identity (1.5) provides a convenient formula for the fcth Fourier coefficient of g, 
corresponding to the orthogonal polynomial Pk in (1.4). For its proof, we make use of a 
novel "Rodrigues inversion" formula that may be of some interest in itself. An identity 
similar to (1.5) holds for the discrete Pearson (Ord) family. Application of (1.5) and its 
discrete analog yields the corresponding lower variance bounds, obtained in Section 4. 
The lower bound for the Poisson(A) distribution, namely, 

" \fc 
Varg(X)>^-E2[A'^[5(X)]] (1.6) 

fe=i 
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(cf. [21]) and the corresponding one for the Normal(^,(T^) distribution [20], 

n , 2\k 

Varg(X)>5]^E2[.gW(X)], (1.7) 

fe=i 

are particular examples (Examples 4.1 and 4.5) of Theorems 4.1 and 4.2, respectively. 
Both (1.6) and (1.7) are particular cases of the finite form of Bessel's inequality and, 
under completeness, they can be extended to the corresponding Parseval identity. In 
Section 5, we show that this can be done for a fairly large family of r.v.'s, including, of 
course, the normal, the Poisson and, in general, all the r.v.'s of the Pearson system which 
have finite moments of any order. For instance, when X is Normal(/i, a"^), inequality (1.7) 
(and identity (1.5)) can be strengthened to the covariance identity 

Cov[.gi(X),.g2(X)]=^i^E[gf)(X)]E[gf(X)], (1.8) 

fc=i 

provided that for i = l,2,g^(E ]D)°°(R), E|gf'^ (X)| < oo, fc = 1, 2, . . . , and that E[g.,{X)]'^ < 
(X). Similar identities hold for Poisson, negative binomial, beta and gamma distributions. 
These kinds of variance/covariance expressions may sometimes be useful in inference 
problems - see, e.g., the Applications 5.1 and 5.2 at the end of the paper. 

2. Discrete orthogonal polynomials and the 
covariance identity 

In order to simplify notation, we assume that X is a non-negative integer-valued r.v. 
with mean ^ < c». We also assume that there exists a quadratic q{x) = Sx^ + /3x + 7 such 
that 

X 

^(M-j)pO')='Z(a;)p(a;), x = 0,l,..., (2.1) 

where p(a;) is the probability function oi X. Relation (2.1) describes the discrete Pearson 
system (Ord family) [23]. Let A'^ be the forward difference operator defined by A[g(.T)] = 
g(x + l)-g{x) and A''[g{x)] = A[A'''^[g{x)]] (A"[.g] =g, A^ = A). We also set q^''^{x) = 
qlx)q{x + I) ■ ■ ■ q{x + k - 1) (with qM =1, ql^l =q). 
We first show some useful lemmas. 

Lemma 2.1. // h{x) = for x <0 and 

00 
^|A^■[/^(x-J)]A'^-^■[g(x)]|<oo /or j - 0, 1, . . . ,fc, (2.2) 

x=0 

lirn A^[h{x-j)]A''-^-^[g{x)]^0 /or j = 0, 1, . . ., fc - 1, (2.3) 
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then 



oo 



x=0 

(2.4) 



x=0 

Proof. Wc have 



x=0 x=0 



= lim 



J2Hx)A%ix)]= lim Y.hix)iA''-'[gix + l)]-A'-^g{x)]) 

=0 

n+1 

/j(7i + l)A'=-i[g(n + l)]-^A[/i(x-l)]A'=-i[g(x) 

oo 

= lim h{n+\)A^-\g(n^\)\-"y A\h(x~\)\A^-%{x)\ 

oo 

= -Y,A[h{x~l)]A>^-'[g{x)]. 

x=0 

By the same calculation, it follows that 

oo oo 

(-i)^X ^' ['^(^ - j)]^'"' [5(^)H (-1F+' E ^'^' [^(^ - J' - 1)]^'"'"' [5(^)] 

x=0 x=0 

for any j e {0, l,...,fc- 1}. D 

Lemma 2.2. For each n>0, there exist polynomials Qi^„{x), i = 0, 1, . . . ,n, such that 
the degree of each Qi_n is at most i and 

A' [^["1 (a; - n)p{x - n)] = gl"-*! {x-n + i)p{x -n + i)Q,,„(x), i = 0, 1, . . . , n. (2.5) 

Moreover, the leading coefficient (i.e., the coefficient of x"j of Qn.n 'is given by 
lead(Q„^„) ~ (~l)"n7=n-i(-'^ ^ j^)' where an empty product should be treated as 1. 

Proof. For n = 0, the assertion is obvious and Qofl{x) = 1- For n = 1, the assertion 
follows from the assumption (2.1) with Qo,i{x) = 1, Qi,i{x) = fi — x. For the case n > 2, 
the assertion will be proven using (finite) induction on i. Indeed, for i = 0, (2.5) holds 
with Qo^n{x) = 1. Assuming that the assertion holds for some z € {0, 1, . . . , n — 1} and 
setting hn{x) = q'"! (a; — n)p{x — n), it follows that 

A'+'h^{x) = A[A'hn{x)] 
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= A[hn^i{x)Qi^n{x)] 

= A[q{x -n + i)p{x -n + i)(q["-*-^l {x-n + i + l)g,,„(a;))] 
= q{x-n + i + l)p{x -n + i + l)A[q[""'"il {x - n + i + l)g,,„(a:)] 
+ {fi-{x-n + i + l))p(.T -n + i + l)^!""*"^! {x-n + i + l)Q,,„(x), 

where the obvious relation A[q{x)p{x)] ~ {fj, — {x + l))p{x + 1), equivalent to (2.1), has 
been used with x — n + i in place of x. Moreover, 

A[g["-'-il(.T-n + z + l)Q„,(a;)] 

= q["-*-il {x-n + i + 2)A[Q,,„(2;)] + g,,„(.T)A[<7["-*-il (x-n + i + l)] 

and 

A[q["~*-il (a- - 71 + i + 1)] = q["-»-2] (x-n + i + 2){q{x) - q{x - n + i + 1)) 

(where, for i = n — 1, the right-hand side of the above should be treated as 0). Observing 
that 

q{x-n + i + 1)(?1"~''~^1 {x~n + i + 2){q{x) - q{x - n + i + 1)) 
= g["-^-il {x~n + i + l){q{x) -q{x-n + i + l)) 

(which is also true in the case where i = n — 1), the above calculations show that (2.5) 
holds with 

where Pi^n{x) = /i — (x — 7i + i + 1) + q{x) — q{x — n + z + 1) is a linear polynomial or a 
constant. From the above recurrence, it follows immediately that lead(gi+i:„) = — (1 — 
(27T, — I — 2)(5)lead(gi^„), i = 0,l,...,n— 1; this, combined with the fact that lead((5o.n) = 
1, yields the desired result. D 

It is easy to see that under (2.1), the support of X, S{X) — {x ^ Z:p{x) > 0}, is a 
finite or infinite integer interval. This integer interval will be denoted by J. Here, the 
term "integer interval" means that "if j'l and j2 are integers belonging to J, then all 
integers between ji and j2 also belong to J" . 

Lemma 2.3. For each fc = 0, 1, 2, . . . , define the functions Pk{x), x € J , by the Rodrigues- 
type formula 

Pk{x) = izl)!A'=[gW(x-fc)p(x- fc)] 
P\x) 

(2.6) 
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We then have the following: 

(a) Each Pk is a polynomial of degree at most k, with lead(Pfe) = n7"=fe-i(l ~ 3^) 
(in the sense that the function Pfe(x), x € J, is the restriction of a real polynomial 
Gk{x) = X)j=o '^{^^J)^'' 1 a; G M, of degree at most fc, such that c(fc, k) = lead(Pfc)). 

(b) Let g be an arbitrary function defined on J (the integer interval support of X) and, 
if J is infinite, assume in addition that the functions g and h{x) := q^'^'{x)p{x) satisfy 
the requirements (2.2) and (2.3) of Lemma 2.1. Then, 

nPt,{X)g{X)\ < oo, E[qW(X)|A'^L9W]|] < oo 

and the following identity holds: 

E[P,(X)5(X)] =E[gW(X)A'=[5(X)]]. (2.7) 

Proof. Part (a) follows from Lemma 2.2 since Pk = { — ^)^Qk,k- For part (b), assume 
first that p(0) > 0, that is, the support J is either J = {0, 1, . . .} or J = {0, 1, ... , N} for 
a positive natural number N . In the unbounded case, (2.7) follows by an application 
of Lemma 2.1 to the functions h{x) = q^^\x)p{x) and g since they satisfy the condi- 
tions (2.2) and (2.3). For the bounded case, it follows by (2.1) that x = iV is a zero 
of q{x) so that q{x) = {N — x){fi/N — Sx), where, necessarily, S < fj./{N{N — 1)). Thus, 
in the case where k > N, q^''\x) = for all x e J so that the right-hand side of (2.7) 
vanishes. On the other hand, the left-hand side of (2.7) (with P^ given by (2.6)) is 
X]x=o5(^)X]7=o(~l)'^~"'(j)'?''^'(2^ ~ j)?'(^ ~ .?) ^i^d it is easy to verify that for all a; G J 
and all j G {0, 1, . . . , fc}, the quantity gl*^' (a; — j)p{x — j) vanishes. Thus, when k > N, 
(2.7) holds in the trivial sense = 0. For k < N, the left-hand side of (2.7) equals 

E(-1)'"M J 5]<zW(a:)p(x)g(x+j) 

j=0 \-' '' x = -j 

j=0 ^ ^ a:=0 

N min{A:,JV-x} , , 

=^gW(x)p(x) Yl i-ir-'lAgi^+j) 

N-k k . s 

= ^ gW(x)p(.T)^(-l)^-^- ( ^ ) g{x+j), 

x=0 j=0 ^ -^ 

where we have made use of the facts that p{x) = for x < and ql'^l (x) =0 ioi N — k < 
X < N. Thus, (2.7) is proved under the assumption p{0) > 0. For the general case, where 
the support of X is either {m, tti + 1, . . . , N} or {m,m + 1, . . .}, it suffices to apply the 
same arguments to the r.v. X — m. D 
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Theorem 2.1. Suppose that X satisfies (2.1) and has 2n finite moments for some n > 
1. The polynomials Pk, fc = 0, l,...,n, defined by (2.6), then satisfy the orthogonality 
condition 

2k-2 

E[Pfe(X)P,„(X)]=4,n,fc!E[gW(X)] [] (l-j<5), fc,m = 0,l,...,n, (2.8) 

j=k-i 

where 5k,m is Kronecker's delta. 

Proof. Let < m < fc < n. First, observe that g''^' is a polynomial of degree at most 
2fc and Pm a polynomial of degree at most to. Note that the desired result will be 
deduced if we can apply (2.7) to the function g ~ P,„; this can be trivially applied when 
J is finite. In the remaining case where J is infinite, we have to verify conditions (2.2) 
and (2.3) of Lemma 2.1 for the functions h = q^'^^p and g = Pm, or, more generally, for 
any polynomial g of degree less than or equal to k. Since the case to, = is obvious 
{Po{x) = 1), we assume that 1 < m < k < n. Observe that (2.2) is satisfied in this case 
because of the assumption ElXp*^ < cxd. Indeed, from Lemma 2.2. A^q^'^^x — j)p{x — j)] = 
p{x)q^''~^^ {x)Qj_k{x — j + k), where Qj,k is of degree at most j and gl'^'Jl is of degree at 
most 2fc — 2j so that their product is a polynomial of degree at most 2k — j, while A'^^-' [g] 
is a polynomial of degree at most j. On the other hand, since q{x)p{x) is eventually 
decreasing and J2'^=o^'^^~'^'i(-'^)Pi^) *^ °^' ^^ have, as y — ^ oo, that 

g(2y)p(2y)y(y + l)2'=-2< ^ x^''-^qix)p{x)-^0 and 

x=y+l 
2y+l 

9(2y+l)p(2y+l)(y+l)2fc-i< ^ x^''~^qix)pix) -^ 0. 

x=y+l 

Hence, limj^^oo x'^''~^q{x)p{x) — 0. For j < fc — 1, wc have, from Lemma 2.2. that 

A^[hix - j)]A''-^-'[gix)]^q{x)p{x)R{x), 

where 

Rix) = g[^-J-il {x + l)Q,.k{x - J + fc)A^-^-i [g{x)] 

is a polynomial of degree at most 2fc — 1. This, combined with the above limit, verifies 
(2.3) and a final application of (2.7) completes the proof D 

The covariancc identity (2.7) enables the calculation of the Fourier coefficients of any 
function g in terms of its differences A''[g], provided that conditions (2.2) and (2.3) are 
fulfilled for g and h{x) = q^''\x)p{x). Since this identity is important for the applications, 
we state and prove a more general result that relaxes these conditions. The proof of this 
result contains a novel inversion formula for the polynomials obtained by the Rodrigues- 
type formula (2.6). 
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Theorem 2.2. Assume that X satisfies (2.1) and has 2k finite moments, and suppose 
that for some function g defined on J , 

E[gW(X)|A'=Lg(X)]|]<oo. 

Then, 

E|Pfe(X)g(X)|<oo 

and the covariance identity (2.7) holds. Moreover, provided that fc > 1 and X has 2k — 1 
finite moments, the following "Rodrigues inversion" formula holds: 

gW(x)p(x) = --— Y. {y-x-l)k-iPk{y)p{y), x- = 0,l,..., (2.9) 

'^ ''■ ij=x+l 

where, for x € R, (.t)„ = x{x — 1) • • • (x — 7i + 1), n = 1, 2, . . . , and (.t)o = 1. 

Proof. Relation (2.7) is obvious when fc = 0. Also, the assertion follows trivially by 
Lemma 2.3(b) if J is finite. Assume, now, that k > 1 and that J is unbounded, fix 
s e {0, 1, . . .} and consider the function 

9s,k{^) :== Y, -7T-J{x >s + l){x - s - l)k-i, X = 0, 1, ... . 

(fc-1)! 

It is easily seen that the pair of functions g = gg.k and h{x) = q^''\x)p{x) satisfy (2.2) 
and (2.3) and also that A''"[gs,fc(x)] = I{x = s). Thus, by (2.7), we get (2.9) (cf. formulae 
(3.6) and (3.7), below, for the continuous case), where Pk is defined by (2.6) and the 
series converges from Lemma 2.3(a) and the fact that X has 2fc — 1 finite moments (note 
that 2fc — 1 finite moments suffice for this inversion formula). Since Pk is a polynomial 
and the left-hand side of (2.9) is strictly positive for all large enough a;, it follows that 
Pk{y) > for all large enough y. Using (2.9), the assumption on A'^[g] is equivalent to 
the fact that 



_. oo oo 

---i^|An5(:r)]| Y. {y-x-l)k-iPk{y)p{y)<^ 

^ '' x=0 y=x+l 

and arguments similar to those used in the proof of Theorem 3.1(b) below show that 

_. oo oo 

— -— ^|A'^L9(^)]| Y iy-^-i)k-i\Pk{yMy)<^. 

^ '' x=0 y=x + l 

Therefore, we can interchange the order of summation, obtaining 

_. oo oo 

EbW(X)A'^-[g(X)]] = ^^-^5]A^-[5(x)] ^ iv - ^ - l)k-iPk{y)p{y) 



y=x + l 
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oo y-l 

^ '' y=l x=0 

= E[PkiX)G{X)l 
where 

Gix)^—^Y.(x-l-y)k-iA''[giy)l x = 0,l,..., 

and where an empty sum should be treated as 0. Taking forward differences, it foUows 
that A'^[G(a;)] = A'^[(7(a;)] so that G = g + Hk-i, where Hk-i is a polynomial of degree 
at most k—1, and the desired result follows from the orthogonality of Pk to polynomials 
of degree lower than k. This completes the proof. D 

3. The generalized Stein-type identity for the 
continuous case 

The orthogonality of polynomials (1.4) has been shown, for example, in [17]; see also 
[24, 28]. For our purposes, we review some details. 
The induction formula, as in (2.5), here takes the form 

^[qH^)f{^)]=q'''ix)f{^)Q^A^)^ * = o,i,...,fc, (3.1) 

ax^ 

with Qo^ki^) ~ 1, where Qi_k is a polynomial of degree at most i and the explicit recur- 
rence for Qi^fc is 

Q^+l,k{x) = {fi-x + {k-i- l){26x + (i))Q^.k{x) + q{x)Q[^k{x), i = 0, 1, . . . , fc - 1. 

This immediately implies that lead(Pfe) = (— 1)*" lcad(Qfc,fc) =n7=fe-i(l ^ J^)-. ^^ i^i the 
discrete case; see also [7, 17]. The covariance identity, as in (2.7), here takes the form 
(after repeated integration by parts; cf. [22, 28]) 

E[Pk{X)g{X)]=E[q''{X)g^''\X)l (3.2) 

provided that the expectations are finite and 

hm g'+i(x)/(a;)Qfc_,_i.fc(a;).g(')(a;) 

(3.3) 
= lim g'+i(x)/(x)Qfc-,-i,fc(a:)gW(a^)=0, z = 0, 1, . . . ,fc - 1 

(here, (r, s) = {x: f{x) > 0}; that the support is an interval follows from (1.2)), where Qi,fe 
are the polynomials defined by the recurrence above. Obviously, an alternative condition. 
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sufficient for (3.3) (and, hence, also for (3.2)), is 

lim q'+\x)f{x)x^g^'^x)= lim q'+\x)f{x)x^g^'\x)^0, 

x^-r-\- x^-s — 

(3.4) 
i = 0, l,...,fc-l,j = 0,l,...,fc-i-l. 

Assuming that X has 2k finite moments, fc > 1, it is seen that (3.4), and hence (3.2), 
is fulfilled for any polynomial g of degree at most fc. For example, for the upper limit, 
we have \im.x-^s-q{x)f{x) = so that (3.4) trivially holds if s < oo; also, if s = +oo, 
then (3.4) follows from q{x)f{x) = 0(2;"^^*^"^^) as a; — >■ +cx), which can be shown by 
observing that q{x)f{x) is eventually decreasing, positive and, by the assumption of 
finite 2fcth moment, satisfies lima-^+oo /^/2 2/^*'~^'7(j/)/(y) dy = 0. Therefore, the explicit 
orthogonality relation is 

2fc-2 

E[Pk{X)P^{X)] ^ 6k^mkmq\X)] 11 {l-jS), fc,m = 0,l,...,n, (3.5) 

where Sk.m is Kronecker's delta, provided that X has 2n finite moments. The proof 
follows by a trivial application of (3.2) to g{x) = Pm{x), for < m < fc < n (cf. [28]). 

It should be noted, however, that the condition (3.4) or (3.3) imposes some unnecessary 
restrictions on g. In fact, the covariance identity (3.2) (which enables a general form of 
the Fourier coefficients of g to be constructed in terms of its derivatives) holds, in our 
case, in its full generality; the proof requires the novel inversion formula (3.6) or (3.7) 
below, which may be of some interest in itself. 

Theorem 3.1. Assume that X satisfies (1.2) and consider the polynomial Pk{x) defined 
by (lA), where {r,s) = {x: f{x) > 0}. 

(a) // X has 2k — 1 finite moments (fc > 1), then the following "Rodrigues inversion" 
formula holds: 

9'W/(^)-77^ l\^-yt''Pk{y)I{y)<^y (3.6) 



(fc-l)! 

1 

(fc^T)! 



{y-xf-^Pk{y)f{y)dy, xe(r,s). (3.7) 



(b) If X has 2fc finite moments and W.q^ {X)\g'^''\X)\ < oo, then W\Pk{X)g{X)\ < oo 
and the covariance identity (3.2) holds. 

Proof, (a) Let Hi{x), H2{x) be the left-hand side and right-hand side, respectively, 
of (3.6). It is easy to see that the integral H2{x) is ffiiite (this requires only 2k — 1 fi- 
nite moments). Moreover, expanding {x — y)^~^ in the integrand of H2{x) according to 
Newton's formula, it follows that H2 {x) = (— l)'^Pfc(a;)/(a;), a; G {r,s), and, thus, by 
the definition (1.4), {Hi{x) - H2{x))'-''^ = H^^\x) - H^\x) vanishes identically in {r,s). 
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Therefore, Hi — iJ2 is a polynomial of degree at most fc— 1. By (3.1), \imx^r+ H\^' (x) = 
for all i == 0, 1, . . . , fc — 1 because q{x)f{x) — >■ as x — > r+ and, for the case r = — oo, 
q{x)f{x) = o(a;^(^'°^^') as x — > — oo since the (2fc — l)th moment is finite, q is of de- 
gree at most 2 and q{x)f(x) is increasing and positive in a neighborhood of — oo. Sim- 
ilarly, using the fact that Pk is a polynomial of degree at most k and observing that 
lim^^r+ x^ J^ y^^^~^~''f{y) dy = for aU i = 0, 1, . . . , fc - 1, j == 0, 1, . . . , fc (again, 2k - 1 

finite moments suffice for this conclusion), it follows that lim2;_j.r+ ^2 (^) ~0 ^^r all 
i = 0, 1, . . . , fc — 1. This proves that Hi — H2 vanishes identically in (r, s) and (3.6) fol- 
lows. Finally, (3.7) follows from (3.6) and (3.2) with g{y) = [x — y)^~^ (the validity of 
(3.2) for polynomials g of degree at most k — 1 can be shown directly, using repeated 
integration by parts, as above). 

(b) Suppose that A: > 1; otherwise, since Po{x) = 1, we have nothing to show. Since 
E[Pfe(X)] = ¥.[Pk{X)Po{X)] = from (3.5), either Pk{x) vanishes identically for x e (r, s) 
(in which case, (3.2) trivially holds) or, otherwise, it must change sign at least once in 
(r, s) . Assume that Pk is not identically zero and consider the change-sign points of Pk in 
(r, s), say, pi < p2 < ■ ■ ■ < Pm (of course, 1 < m < fc because Pk is a polynomial of degree 
at most fc). Fix a point p in the finite interval [pi,pm] and write, with the help of (3.6) 
and (3.7), 

nq''{X)\g^'^HX)\] 

^"^^' ''"ig^'^Hx)] r{x-y)'^-^Pk{y)f{y)dydx (3.8) 



{k-iy.Jr 



^ ' l.9'''(a;)| / {y-x)'^-'Pk{y)f{y)dydx. 



(fc-1) 



Because of the assumption on g, both integrals on the right-hand side of (3.8) are finite. 
We wish to show that we can change the order of integration in both integrals in the 
right-hand side of (3.8). This will follow from Fubini's theorem if it can be shown that 



Iip)= \g''>ix)\ iy^xr-'\Pkiy)\fiy)dydx<oo (3.9) 

and similarly for the other integral in (3.8). Since q{x)f{x) > for all x G (r, s) (see (1.2)), 
it follows that q''{x)f{x) > for all x £ {r,s) as well. Thus, from (3.7), we get 

iy-x)''-'Pk{y)f{y)dy>0, xe[p,s). (3.10) 

On the other hand, Pk{x) does not change sign in the interval {pm, s) and, hence, Pk(x) > 
for all X G {pm, s), showing that 

|g(^)(a;)| f {y - xf-^\Pk{y)\f{y)dydx 

(3.11) 
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\9^'H^)\ f{y-xf-^P,{y)J{y)dyAx. 
By the above considerations, it follows that 

H{p):^ ini Mx):^ mi f {y - xf'' Pk(y)fiy)dy > 0, (3.12) 

S{p):^ sup s{x):^ sup j^{y~xf-^\Pk{y)\f{y)dy<^, (3.13) 

D{p):^ sup d{x):^ sup f iy^x)''-^P,,iy)f{y)dy<oo (3.14) 

xelp.Pm] xe[p,Pm]J Pm 

because the three positive funetions h(x), s(x) and d(x) defined above are obviously 
continuous and x Hes in the compact interval [p, Pm] (note that h(x) > by (3.10)). Now, 
from the inequalities s{x) < j}f'\ h{x) and d{x) < „\''l h{x), x G [p,pm], we conclude that 

'"iff^'H^)! r{y-xf-'\Pk{y)\f{y)dydx 

p J X 

= I "^\g^^\x)\{s{x)+d{x))dx (3.15) 

J p 

<^^^^^^ p\g^'\x)\ j\y-xf-'Pu{y)f{y)dydx. 

Combining (3.11) and (3.15), we see that there exists a finite constant C{p) (take, for 
example, C{p) — max{l, {S{p) + D{p))/H{p)}) such that 

I{p)<C{p) f\g^''\x)\ f{y-xf-^Pr,{y)f{y)dydx<^ 

J p J X 

and, thus, by (3.9), we can indeed interchange the order of integration in the second 
integral in the right-hand side of (3.8). Similar arguments apply to the first integral. By 
the above arguments and by interchanging the order of integration in both integrals in 
the right-hand side of (3.8) (with g'^^^ in place of l^^'^'l), we obtain 

E[9^(X).gW(X)] =E[Pfc(X)G(X)], (3.16) 

where 

G{x) - ^^^ j\y - xf-^g^^^ (y) dy (3.17) 

= jj^fix~y)'-'g^''Hy)dy, xeir,s). (3.18) 
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Differentiating (3.17) or (3.18) k times, it is easily seen that G*-*^^ = 5*-*^^ so that G — g = 
Hk-i is a polynomial of degree at most k — 1 and the desired result follows by (3.16) and 
the orthogonality of Pk to polynomials of degree lower than k. This completes the proof 
of the theorem. D 



4. An application to lower variance bounds 

A simple application of Theorem 2.2 leads to the following lower variance bound. 

Theorem 4.1. Fix n € {1,2,...} and assume that X satisfies (2.1) and has 2n finite 
moments. Then, for any function g satisfying 

E[gW(X)|A^-[g(X)]|]<oo /or fc = 0, 1, . . .,n, (4.1) 

the bound 

Y.r,(X)>± «'fe"(X)A-'b(X)|] 

holds (where the fcth term in the sum should be treated as zero whenever E[g[''l(X)] 
vanishes) with equality if and only if g is a polynomial of degree at most n. 

Proof. Assume that E[g^(X)] < 00 (otherwise, we have nothing to show). By Theorem 
2.1, the polynomials {Pk / \/E[P^ (X)]; fc = 0, 1, . . . , min{7i, N}} form an orthonormal basis 
of all polynomials with degree up to n, where A^ + 1 is the cardinality of J. Observing 
that the fcth Fourier coefficient for g is, by (2.7), (2.8) and Theorem 2.2, 

^^^4^^W- n,^''(^lfy(^)^^ , fc<min{n,A.}, 

EV2[p2(^)] (fc!E[gW(A)]n-=^!i(l-J'5))V2' - ^ ' ^' 

the desired result follows by an application of the finite form of Bessel's inequality. D 

It is worth mentioning here the similarity of the lower variance bound (4.2) with the 
Poincare-type (upper/lower) bound for the discrete Pearson family, obtained recently in 
[2], namely 

(~1)" Var.9(A)-^ ^,J E[gW(A)(A'-Lg(A)])^] > 0. (4.3) 

v fc=i^!nj=o(i-j'5) / 

The following examples can be verified immediately. 

Example 4-1- If A is Poisson(A), then q{x) = A so that 5 = and (1.6) follows from 
(4.2) (sec also [21]). Moreover, the equality in (1.6) holds if and only if g is a polynomial 
of degree at most n. 
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Example 4-2. For the binomial ( A'', p) distribution, q{x) = {N — x)p so that (5 = and 
E[gW(X)] = {N)kp''{l-pf. Thus, (4.2) yields the bound 

niin{7i,A'^} 7, 

Var,(X)> g fci(]^o5rr^IE^[(^-^)^^'=[^(^)]] 

with equality only for polynomials of degree at most n. Note that there is equality if 
n>N. 

Example 4-3. For the negative binomial(r,p) with p{x) = {r + x — l)xP^{l — p)^ /xl, 
a; = 0, 1, ... , (2.1) is satisfied with q{x) = (1 - p){r + x)/p. Thus, 5 = 0, E[gW (X)] = 
(1 — p)^[r]k/p'^^ and (4.2) produces the bound 

Var5(X) > X] %rf^E'[[r + ^IfcA'^bW]] 



fe=i 



(in the above formulae and elsewhere in the paper, [x\n = x{x + 1) • • • (x + n — 1) if 7i > 1 
and [xjo = 1). 

Example 4-4- For the discrete Uniformjl, 2, . . .,N}, (2.1) is satisfied with q{x) = x{N — 
x)/2; thus, 5 — —1/2 and (4.2) entails the bound (which is an identity if n > iV — 1) 

min{n.A^— 1} , , . , 

Var.9(X)>iV g ^ (t!)^(^;fc)T^' ^^[W^(^-^)^-^''[-'^(-^)]]- 

The lower variance bound for the continuous Pearson system is stated in the following 
theorem; its proof, being an immediate consequence of (3.2), (3.5), Theorem 3.1 and 
a straightforward application of the finite form of Bessel's inequality (cf. the proof of 
Theorem 4.1 above), is omitted. 

Theorem 4.2. Assume that X satisfies (1.2) and has finite moment of order In for some 
fixed n> 1. Then, for any function g satisfying E,[q'' {X)\g^''' {X)\] < oo, fc = 0, 1, . . . , n, 
we have the inequality 

with equality if and only if g is a polynomial of degree at most n. (Note that E|Xp" < oo 
implies 5<{2n- l)-^ and, thus, that 5 i {1, 1/2, . . . , l/(2n - 2)} if n > 2.) 

Some examples now follow. 
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Example 4-5- If X is Normal(/i,(T^), then q{x) = a^ and (4.4) yields the Houdre- 
Kagan variance bound (1.7) (see [20]), under the weaker assumptions E|(7('^^(X)| < oo, 
fc = 0,l,...,n; equahty holds if and only if p is a polynomial of degree at most n. 

Example 4.6. If X is r(a, A) with density X'^x'^-^e-^'' /T{a), x>0, then q{x) = x/X, 
E[g'=(X)] = [a]fc/A2'= and (4.4) entails the bound 



n 

Varg(X) > ^ — ^E2[xV'H^)] 



fc=i 
with equality only for polynomials of degree at most n. 

Example 4.1. For the standard uniform density, q(x) = x{l — .i;)/2, 5 = —1/2, 
E[g'=(X)] == (fc!)V(2'^'(2fc + 1)!) and wc get the bound 

Varg(X) > X: ^E^I^'d " Xfg'~^\X)] 

with equality only for polynomials of degree at most n. Similar inequalities hold for all 
beta densities. 

Of course, in the above three examples, the corresponding orthogonal polynomials 
(1.4) are the well-known Hcrmite, Laguerre and Jacobi (Legendre), respectively, so that 
one can alternatively obtain the results using explicit expressions for the variance and 
generating functions for the polynomials (see, e.g., [5, 6, 12, 16, 19]); this is also the 
case for the discrete polynomials corresponding to Examples 4.1-4.4 (namely, Charlier, 
Krawtchouck, Meixner and Hahn, respectively). However, as will become clear from the 
following example, the considerations given here do not only simplify and unify the 
calculations, but also go beyond the classical polynomials. 

Example 4-8. If X follows the t^ distribution (Student's t with N degrees of freedom) 
with density 

,, , r((iV+l)/2)/ .^2X-(JV+l)/2 



/NnT{N/2) 

then it is well known that X has only A^ — 1 finite integral moments. However, for A^ > 1, 
X satisfies (1.2) and its quadratic q{x) = {N + x'^)/{N -1) has S = 1/{N-1). Thus, (4.4) 
applies for sufficiently large N (see also [22] for a Poincare-type bound corresponding to 
(4.3)). To this end, it suffices to calculate 

%^x)]^(^)'n(i+^), fc<(iv-i)/2. 
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and rijtfc^ i(l - J^) = iN - k)k/{N - 1)''. Theorem 4.2 yields the (non-classic) bound 

,^,^^ E^[(JV + X^)V^)(X)] 7V-1 

Varg(A)> > ; , n< — - — , 

t{k\N'^iN-k),YlU(^ + l/{N-2j)) - 2 

with equality only for polynomials of degree at most n. 

It seems that it would be difficult to work with the explicit forms of the corresponding 
orthogonal polynomials, obtained by (1.4). Note that a similar bound can be easily 
obtained for the Fisher-Snedecor F^.n^ distribution and that Schoutens [31] has obtained 
the corresponding Stein's equation, useful in approximating the iTv-distribution. 

5. A general variance/covariance representation 

The main application of the present article (Section 4) presents a convenient procedure 
for approximating/bounding the variance of g{X) when g is smooth enough and when 
X is "nice" enough (Pearson). Although the procedure is based on the corresponding 
orthonormal polynomials, (pk = Pfc/E^/^[P|], the main point is that we do not need 
explicit forms for Pk. All we need are the Fourier coefficients of g, Ck =E[(/)fcg], but, 
due to the identities (3.2) and (2.7), the Fourier coefficients can be simply expressed 
in terms of the quadratic q and the derivatives/differences of g when X belongs to the 
Pearson/Ord family, that is, when (1.2) or (2.1) is satisfied. 

A natural question thus arises: is it true that the nth partial sums, given by the 
right-hand sides of (4.2) and (4.4), converge to the variance of g{X) as n -^ oo? 
More generally, assume that we want to calculate Var(7(X), when X is an r.v. with 
finite moments of any order. Let /i be the probability measure of X, that is, n sat- 
isfies fx{—oo,x] = Pt{X < x), x £ R, and assume that the support of /i, supp(/^), is 
not concentrated on a finite number of points (otherwise, the following considerations 
become trivial). It is well known that there exists an orthonormal polynomial sys- 
tem (OPS) T = {00, i/)!, . . .}, which can be obtained by an application of the Gram- 
Schmidt orthonormalization process to the real system To = {l,x,x^,. . .} C L^(M, /x). 
Each (real) polynomial (pk is of degree (exactly) k and satisfies the orthonormality con- 
dition E[(j)i{X)(j)j{X)] = J^(f)i{x)(l)j{x) diJ,{x) = 5ij. The members of J^ are uniquely de- 
termined by the moments of X (of course, any element of J^ can be multiplied by ±1). 
For any function g E L^(R,/i) (i.e., with finite variance), we first calculate the Fourier 
coefficients 



Ck = E[g{X)cj)k{X)] =. / M^)9{^) Mx), fc = 0, 1, 2, . . . , (5.1) 

and then use the well-known Bessel inequality, 

oo 

Var.g(X)>^4, (5.2) 



fc=i 
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to obtain the desirable lower variance bound. Clearly, Theorems 4.1 and 4.2 just provide 
convenient forms of the nth partial sum in (5.2) for some particularly interesting cases 
(Pearson/Ord system). It is well known that the sum in the right-hand side of (5.2) 
is equal to the variance (for all g G X^(M, /z)) if and only if the OPS T is complete in 
L^ (R, /x) (and, thus, it is an orthonormal basis of L'^ (M, /z)) . This means that the set of real 
polynomials, span[Jx)], is dense in L'^{M.,fi). If this is the case, then Bessel's inequality, 
(5.2), is strengthened to Parscval's identity, 

oo 

YavgiX) = ^ 4 for any g € L^iR, ^i). (5.3) 

fe=i 

The following theorem summarizes and unifies the above observations. 

Theorem 5.1. Assume that X has probability measure /i and finite moments of any 
order. 

(a) If X satisfies (1.2) and if g G L'^{R, ii)r\ D°°{r,s), then (5.3) can be written as (cf. 
Theorem 4.2) 

Y.„(X)^t '^''^''■^f:'-'^'' , (5,4) 

provided that the polynomials are dense in L^(R,/i) and that 

E[q^{X)\g(''\X)\]<oo, fc = 0,l,2,.... (5.5) 

(b) Similarly, if X satisfies (2.1), if fi is not concentrated on a finite integer interval 
and if g G L^(M, /x), then (5.3) yields the identity (cf. Theorem 4.1) 

provided that the polynomials are dense in L^(R,/i) and that 

E[qW(X)|A^L9(^)]|]<c», fc = 0,l,2,.... (5.7) 

It should be noted that (5.6) is always true (and reduces to a finite sum) if X belongs 
to the discrete Pearson (Ord) family and the support of /i is finite. In this case, the sum 
adds zero terms whenever E[(7['''1(X)] = 0. On the other hand, it is well known (due to 
M. Ricsz) that the polynomials are dense in L-{R,fi) whenever fi is determined by its 
moments; sec [30] or [3], page 45. An even simpler sufficient condition is when fi has a 
finite moment generating function at a neighborhood of zero, that is, when there exists 
io > such that 

Mxit)=Ee*^ <oo, tei-to,to). (5.8) 
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A proof can be found in, for example, [8]. Since condition (5.8) can evidently be checked 
for all Pearson distributions, we include an alternative proof in the Appendix. 
Taking into account the above, we have the following covariance representation. 

Theorem 5.2. Assume that X has a finite moment generating function at a neighbor- 
hood of zero. 

(a) IfX satisfies (1.2) and if g, e L^{R,fi)r\ D°°{r,s), i = l,2, then 

Cov[gi{X),g2{X)] = ^ 2k-2 ,. TT , (5-9) 

^.^^ fc!E[gnX)]nj^fc-i(l-J'5) 

provided that for i ~ 1,2, 

E[g'Wl5f^WI]<^, fc = 0,l,2,.... (5.10) 

(b) Similarly, if X satisfies (2.1), then 

Cov|,.(X).,.(X)|.g^b"-''-'^'^^b-'^"l-,?f''^'^'''»''""l, (5.11) 

h ™M"(x)in5K,(i-.!<) 

where each term with E,[q'-''' {X)] = should be treated as zero, provided that for i ~ 1,2, 

E[9W(X)|A^L%(^)]|]<oo, fc = 0,l,2,.... (5.12) 

Proof. Let ak ~E[(j)k{X)gi{X)] and f3k =¥.[(j)k{X)g2{X)] be the Fourier coefficients 
of gi and g2- It is then a standard inner product property in the Hilbert space that 
Cov[gi{X),g2{X)] =J2T=i^kl3k- Substituting, for example, 

wu fY^ fY^^ nPk(X)gi{X)] E[gW(X)A'=L9i(X)]] 

ak=K[<pk[X)gi{X)\ = ■ - 



Ei/2[p2(^)] (fc!E[gW(X)n-=fe'i(l -.?'5)])i/2 

(and similarly for the continuous case and for /3k), we obtain (5.9) and (5.11). D 

Application 5.1. Assume that Xi,X2, . . . ,Xi, is a random sample from Geomctric(6'), 
< 6 < 1, with probability function 

pix) = e{i-er, x = o,i,..., 

and let X ~ Xi + • • • + X,^ be the complete sufficient statistic. The uniformly minimum 
variance unbiased estimator, UMVUE, of — log(6') is then given by (see [2]) 

if a: == 0, 

^^^^''^^^ ^- + — T + --- + ^^^^' if^e{l,2,...}. 
ly u + 1 u + X — 1 
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Since no simple form exists for the variance of T^, the inequahties (4.3) have been used 
in [2] in order to prove asymptotic efficiency. However, X is negative binomial(z^, 0) and 

A'[TAX)] = tll^(^^ fc=l,2,..., 
SO that one finds from (5.6) the exact expression (cf. Example 4.3) 



fcfc'(''+r') 



Observe that the first term in the series, (1 — 0)/i', is the Cramer-Rao lower bound. 

Now, let M^^;„ = W^.,niX) = [i/ + X]n/[iy]n be the UMVUE of 6*"" (n = 1, 2, . . .) and 
U^;n = U^,n{X) ^ {v - 1)„/ [z^ - n + X]„ bc thc UMVUE of 61" (?2, = l,2,...,i^- 1). 
{Wy^n{X) is a polynomial, of degree n, in X .) It follows that 



{n)k[v + X + k]n-k 
I\''[W,,n{X)] 



kmr tv\^_) — > fc = 0, l,...,n, 



0, fc = n + l,n + 2,..., 

A [/y:„(A) = — — — , fc = 0,l,2,..., 

[v - n + A J„+fc 
so that 

E[[i. + X]kA''[W,,r.{X)]] = {n)kE[W,,r,{X)] = (71)^^-", fc = 0, 1, . . . , n, 

E[[^ + X]feA^-[C/,.„(X)]] = {-l)''[n]kE[U,,^{X)] = (-l)^-[n]fcr , fc = 0, 1, . . . . 

Using (2.7), (2.8), (5.6), (5.11) and Example 4.3, we immediately obtain the formulae 
Cov[^„W^,;„]=0-"f](-l)^-li5%(l-0)^ n = l,2,..., 

Cov[T„ [/,;„] = -rV-i^(l-0)^ n = l,2,...,z.-l, 

min{n,Tn} / \ / \ 

Cov[W^.;„,W^.;™]=0— ™ V W"^)^ (i„g)fc, n,m=l,2,..., 



Cov[f/.;„, t/.,™] = r+" f; l!M!^(i _ 0)fc 



k=l 



k\[v]u 



n,m — 1,2, ... ,v — 1, 



Cov[T^.,„,t/,,™] = 0™-"f^(-l)^M^(l_0)'=, 

fe=l 'A^lk 

n = l,2,..., 771 = 1, 2, . . . , zy — 1. 
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The above series expansions are in accordance with the corresponding results on Bhat- 
tacharyya bounds given in [9]; these results are also based on orthogonality and com- 
pleteness properties of Bhattacharyya functions, obtained by Seth [32]. Similar series 
expansions for the variance can be found in [1, 25]. 

Next, we present a similar application for the exponential distribution. 

Application 5.2. Assume that Xi,X2, . . . ,X^ is a random sample from Exp(A), A > 0, 
with density f{x) ~ Ac~^^', a; > 0, and let X = Xi + ■ ■ ■ + X,y be the complete sufhcient 
statistic. We wish to obtain the UMVUE of log(A) and its variance. Setting U = log(Xi), 
we find that 

/■OO 

EU= c"" log(a;) dx - log(A) = -7 - log(A), 

Jo 

where 7 = 0.5772 ... is Eulcr's constant. Therefore, —7 — [/ is unbiased and it follows 
that the UMVUE of log(A) is of the form 

L, = L,(X)=E[-7-log(Xi)|X] = -log(X)-7 + V-. 

7 

Since X follows a r{h',X) distribution and Ll '{X) ~ (— l)'^(fc — \)\X^^ ^ we obtain from 
(5.4) (cf. Example 4.6) the formula 

00 
VarL^ = ^ 



fc=i 



fc2(^+-i) 



which is quite similar to the formula for VarTi, in Application 5.1. (Once again, 
the first term in the series, 1/;^, is the Cramer-Rao bound.) Moreover, the series 

Sfc^i (^'^ ( '^^fe^^ ) ) "^^^ b*^ simplified in a closed form. Indeed, observing that 

Varii = X]fc>i 1/fc^ = 7T^/6 and taking into account the identity 



1 ((v + k-\\ ^ (v + k\ \ {v-\)\( 1 1 



k'^W k ) \ k ) ) V \\k\^ [A: + l]i. 

we have 



i/,/c = l,2,. 



Var Li, — Var L^^\ = 






so that 



Var L^ = — — 1-— T 



6 22 iv-iy ^ B' 

^ ' k>u 



y- 
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Finally, using the last expression and the fact that {k + 1) ^ < J/. x ^ dx < k ^, we 
get the inequalities J2k>v(^ + 1)~^ ~ VarL^ — i'~'^ < v^^ < VarL^, that is, 

1 < i^VarL^ < 1 + l/iy, 

which shows that L^, is asymptotically efficient. 



Appendix 

A completeness proof under (5.8). It is well known that, under (5.8), X has finite moments 
of any order so that the OPS exists (and is unique). From the general theory of Hilbert 
spaces, it is known that J^ is a basis (i.e., it is complete) if and only if it is total, that 
is, if and only if there does not exist a non-zero function g G L'^{M.,fi) such that g is 
orthogonal to each 0^. Therefore, it suffices to show that if g E L'^{R,fj,) and if 



E[g{X)<j>k{X)]^0 foraUfc = 0,l,. 



(A.l) 



then PT{g(X) = 0) = 1. Since each (j)k is a polynomial with non-zero leading coefficient, 
(A.l) is equivalent to 



EiX^'giX)]^ / x''g{x)dn{x) = 0, 



n==0,l,.. 



(A.2) 



and it thus suffices to prove that if (A.2) holds, then E|5(X)| = 0. Since, by assumption, 
the functions x i-^ x" and x i— ^ e*^ (|t| < to/2) belong to L^(R, /x). it follows from the 
Cauchy-Schwarz inequality that E[e*'^|(7(X)|] < oo for |i| < to/2 and, thus, that 



E[el*-^l|.g(X)|] <E[c-*-^|g(X)|]+E[e*^|g(X)|] <(», |i| <io/2 

From Bcppo Levi's theorem and (A. 3) it follows that 



(A.3) 



E^ 



l5(^)l 



:E 



2^^;r\9{x)\ 



n=0 



el*-^l|.9(X)|]<oo, \t\<to/2, 



and, therefore, from Fubini's theorem and (A.2), we get 



E[c''^giX)]^E 



E -^9iX) 



.n=0 



^-E[X"9(X)]=0, \t\<to/2. (A.4) 



n=0 



Write g'^{x) = max{p(a;),0}, g [x) = max{— 5(2;),0} and observe that from (A.2) with 
n = 0,"E,g(X) = 0. It follows that Eg-^{X) = Eg-{X) = 6, say, where = E|.g(X)|/2. 
Clearly, < 6' < cx) because both g^ and g~ are dominated by \g\ and, by assumption. 
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\g\ G L^(R, fj.) C L^(IR, fi). We assume now that 9 >0 and we shall obtam a contradiction. 
Under 9 > 0, we can define two Borel probability measures, v'^ and j^~, as follows: 

By definition, both v^ and u~ are absolutely continuous with respect to /i, with Radon- 
Nikodym derivatives 

^v^ 1 4- , X dz^~ 1 , , ^ 



dfj, 9' ' d^ 



Since, by (A.4), 



e*V(^)dM(a;)= /e*^g-(a;)d/.(x), |i| < toA (A.5) 



it follows that the moment generating functions of v'^ and u are finite (for |t| < io/2) 
and identical because, from (A.5), we have that, for any t e (— io/2,io/2), 

e*^di^+(.T) = i /"e*^<?+(a;)dAi(.T) = i [ e'"' g- (x) d^iix) = / e*^dzy-(a;). 

Thus, i^+ = i^^ and choosing A+ = {.T:p+(a;) > 0} C {x:g^{x) = 0}, we are led to the 
contradiction 1 = iy+{A+) = i^^{A+) = 0. 
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